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Direct and Indirect Couplings in Coherent 
Feedback Control of Linear Quantum Systems 

Guofeng Zhang Matthew R. James 
Abstract 

The purpose of this paper is to study and design direct and indirect couplings for use in coherent feedback control 
of a class of linear quantum stochastic systems. A general physical model for a nominal linear quantum system coupled 
directly and indirectly to external systems is presented. Fundamental properties of stability, dissipation, passivity, and 
gain for this class of linear quantum models are presented and characterized using complex Lyapunov equations and 
linear matrix inequalities (LMIs). Coherent H°° and LQG synthesis methods are extended to accommodate direct 
couplings using multistep optimization. Examples are given to illustrate the results. 

Index Terms — quantum feedback control, coherent feedback, dissipation, passivity, gain, H°° control, LQG 
control. 

I. Introduction 

Quantum feedback control involves the interconnection of two systems (the quantum plant and the controller) 
in such a way that the plant-controller system achieves desired performance specifications. The controller may be 
a quantum system, or a classical system (i.e. not quantum), or a mixture of the two. When the controller is a 
classical system, the feedback loop involves measurement, and hence is referred to as measurement feedback, see 
[2], [3], [4], [13], [21], [23], [28], [40], [44], [46], [48]. Measurement feedback necessarily involves the loss of 
quantum coherence in the feedback loop. Measurement feedback control has been applied to the theoretical study 
of spin localization [3], continuous-time quantum error correction [9], [22], (non-orthogonal) optical coherent state 
discrimination [10], fast state purification [11], quantum entanglement generation and preservation [12], deterministic 
state preparation [37], spin squeezing [38], [41], atom lasers [49], feedback control of Bose-Einstein condensates 
(BECs) [34], and so on. Interested readers may refer to survey papers and books [41], [26], [5], [6], [47] for more 
detailed discussions on measurement feedback control. When the controller is a quantum system, the controller 
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exchanges quantum information with the quantum plant in the feedback loop. Such quantum information may flow 
directionally as a (possibly non-commutative) signal like a quantized electromagnetic field or an injected laser [51], 
[54], or directly via a bidirectional physical coupling [45], [24]. Fully quantum feedback is known as coherent 
control. Compared to measurement feedback control, the benefits of coherent feedback include (i) preservation of 
quantum coherence within the whole network, and (ii) high speed (a coherent controller would have similar time 
scale to the plant, and likely is much faster than classical processing). For convenience, in this paper the directional 
information flow is called indirect coupling, while the bidirectional coupling is called direct coupling. 

Several interesting coherent control schemes for quantum systems have been proposed in the literature. All-optical 
(indirect and direct) versus electromechanical measurement feedback schemes are compared in [45], and it is shown 
that squeezed fields may be produced by coherent feedback but not by measurement feedback. Further, the authors 
show in [45] how direct couplings may be used in a feedback loop. Coherent feedback schemes are discussed in 
[24], e.g. an ion (the plant) in an ion trap can be manipulated desirably by adjoining another ion (the controller) to 
the trap which interacts with the ion of interest via some appropriately designed coupling. A scheme is proposed 
in [35] to produce continuous-wave fields or pulses of polarization-squeezed light by passing classical, linearly 
polarized laser light through an atomic sample twice; that is, indirect coupling is utilized to feed the field output 
of the first pass back to the atomic sample again so as to generate polarization-squeezed light. This scheme is 
confirmed and extended in [36]. In [17] indirect coupling is employed to construct bilinear control Hamiltonians 
which have widespread use in quantum applications; bilinear control Hamiltonians are obtained by feeding the 
output field back to the system so as to cancel out the stochastic effects. 

Systematic optimization-based methods for designing indirect coherent feedback systems are given in [20], [29] 
and [27]. These methods apply to a class of linear quantum stochastic systems; here the word 'linear' refers to 
the linearity of the Heisenberg equations of motion for system operators, while the term 'stochastic' refers to the 
quantum noise used to describe the effects of external fields or heat baths interacting with the system. An algebraic 
criterion for physical realizability was given in [20], and this was used in an essential way to determine the coherent 
quantum controllers in [20] and [29]. A detailed account of physical realizability is given in [30]. In [20] a general 
framework for quantum H°° control is developed, where a quantum version of bounded real lemma is proposed and 
applied to derive necessary and sufficient conditions for the H°° control of linear quantum stochastic systems. The 
paper [25] reports a successful experimental demonstration of this approach. A coherent quantum LQG problem 
has been addressed in [29], where it is shown that this problem turns out to be more challenging than the coherent 
H°° quantum control in that a property of separation of control and physical realizability does not hold for the 
coherent LQG problem. The problem of quantum LQG control has also been studied in papers like [53], [55] and 
[52], in the framework of measurement-based feedback control. Linear quantum systems are important not only 
because of their practical importance, as in quantum optics, but also because of their tractability. 

Stability, dissipation, passivity and gain are among the characteristics fundamental to analysis and synthesis of 
feedback systems. The paper [19] extends J.C. Willems' theory of dissipative systems to open quantum systems 
described by quantum noise models. This theory features a physical representation of external systems (or 'distur- 
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bances' or 'exosystems') connected to the system of interest (via direct and/or indirect couplings), and the dissipation 
inequality is defined in these terms. Storage functions are system observables, such as energy, and may be used as 
Lyapunov functions to determine stability. The paper [19] also presents an approach to coherent feedback design 
using physical interconnections. 

This paper concerns the influences and uses of both direct and indirect couplings in coherent quantum feedback 
system analysis and design. The specific aims of this paper are as follows. The first aim is to present a general 
physical model for a nominal linear quantum system coupled directly and indirectly to external systems. The linear 
quantum model features explicit algebraic expressions for the dynamical system matrices in terms of physical 
parameters, as in [16], and important relations including those required for physical realization. In most of the 
paper, the dynamical equations are given in the so-called annihilation-creation form [56, Chapter 7], [16], which 
leads to complex system matrices; it is shown how to convert to a real quadrature form similar to that used in 
[20] and [29]. The model provides a deeper physical understanding for the linear quantum models and disturbances 
studied in [20], [29], [27], [33]. The second objective is to describe stability, dissipation, passivity, and gain for this 
class of linear quantum models. The definitions and characterizations of these properties are specializations of those 
given for more general systems in [19]. The characterizations are algebraic, involving complex Lyapunov equations 
and linear matrix inequalities (LMIs). These results generalize recent results for special cases in [20], [29], [27], 
[33]. Our final objective is to extend the H°° and LQG design methods to include direct couplings. At present, no 
explicit closed-form solutions are known. We give simple examples showing how direct optimization methods may 
be used. More generally, we present multi-step optimization schemes that accommodate direct coupling in coherent 
H°° and LQG design. 

This paper is organized as follows. In section 2, the linear quantum systems of interest are introduced. Section 
II-A presents models of closed (namely, isolated) quantum systems, Section II-B introduces direct coupling between 
two closed quantum systems, Section II-C discusses indirect coupling mediated by quantum field channels, and 
Section II-D presents a more general model which is the main concern of this paper. In Section 3, stability and 
dissipation theory is developed for the above-mentioned linear quantum systems, and versions of the positive real 
and bounded real lemmas are given. Several examples illustrate these properties and characterization results. Section 
II V-AI formulates the closed-loop linear quantum systems containing both direct and indirect couplings. An example 
is given in Section HV-BI to demonstrate how direct coupling may be used to stabilize a feedback system. Coherent 
H°° and LQG controller synthesis problems are investigated in sections ft V-CI and II V-DI respectively. Examples are 
given to illustrate the controller design procedures. 

Finally, some words for notation. 

Notation. Given a column vector of operators x = [ x\ • ■ ■ x m } T where m is a positive integer, define 
x# = [ x\ ■ ■ ■ x* m } T , where the asterisk * indicates Hilbert space adjoint or complex conjugation. Furthermore, 
define the doubled-up column vector to be x = [ x T {x^) T V ■ The matrix case can be defined analogously. The 
symbol diag„ (M) is a block diagonal matrix where the square matrix M appears n times as a diagonal block. 
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Given two matrices U,V e C rxk , a doubled-up matrix A (U, V) is defined as A (U, V) :=[ JJ V; V* U* }■ 
Let I n be an identity matrix. Define J n = diag(7 n , —I n ) and 0„ = [0 I n ; — I n 0]. (The subscript "n" is always 
omitted.) Then for a matrix X <= C 2nx2m , define X b := J m XU n . 

II. Linear Quantum Systems 

A linear quantum system G consists of n interacting quantum harmonic oscillators ([14, Chapter 4]) with 
annihilation operators a = [oi, . . . , a n ] T whose evolutions are given by linear differential equations. The annihilation 
operators are defined by (ajip)(x) = ■^Xjtp(x) + -^=-^-(x) on a domain of functions ip in the Hilbert space 
f)o = i 2 (K ra ,C) and satisfy the commutation relations [aj,a£] = 8jk- The nature of the differential equations 
satisfied by a depends on whether or not the system is closed (isolated from all other systems), or open (interacting 
with other systems), but is always defined in terms of unitary evolution dj(t) = U*(t)a,jU(t), where U(t) is a 
unitary operator given by Schrodinger's equation. While dj, the initial annihilation operator, is defined on fjo, at 
any time t the operator aj(t) may act on a possibly larger Hilbert space S) that may include external degrees of 
freedom. The unitary U (t) is defined on this possibly larger system. 

The general model considered in this paper is illustrated in Figure Q] This arrangement provides a schematic 
representation of how a physical system of interest might be influenced by external systems (e.g. uncertainty, 
disturbances) and noise. The external system Wd is directly coupled to G, while the external system Wf is coupled 
indirectly to G via a quantum field, which is described using a quantum noise signal bi n (t). This model is described 
in detail in section IH-DI The intervening sections explain the physical and system-theoretic basis for the general 
model by discussing models for special cases. 







b,„+W 




bin 




G 


w f 









A 



V 

f 



Fig. 1. General model 

In this paper we assume that all systems are initialized in a Gaussian state, and that all field inputs are Gaussian 
[14, Chapter 4]. 

A. Closed Systems 

In this section we present a dynamical model of a closed quantum system G of an interconnection of n quantum 
harmonic oscillators. According to quantum mechanics, the behavior of a closed quantum system G is determined 
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by the Hamiltonian 



Ho = ~a f 



i7_ n+ 
n* sit 



(i) 



where 17_ and 17 + are respectively <C nxn matrices satisfying 17_ = 17^ and 17 + = OT. In the Heisenberg picture, 
the evolution of the annihilation operators is defined by dj(t) = U*(t)a,jU(t), where U(t) is the solution of 
Schrodinger's equation 

^-U(t)=-iH a U(t), U(0)=I; (2) 
at 

that is, aj(t) = —i[aj(t),Ho(t)}, dj(0) = dj. This leads to the linear differential equation 

a(t) = -iSl-a(t) - iSl+a*(t). (3) 

Note that the equation for a depends on aF, and so we combine this with the differential equation for a# to obtain 

i!7_ iS7+ a(t) 
a*{t) 



a{t) 




a#(t) _ 





This may be written compactly in the form 



with initial condition a(0) = a, where 



iVL* -ifl* 
a(t) = A d(t) 



(4) 



(5) 



A = -A(in_,ifi+). (6) 
We therefore see that the evolution of the system G is described by the linear differential equation (0. 

B. Direct Coupling 

In quantum mechanics, two independent systems G\ and Gi may interact by exchanging energy. This energy 
exchange may be described by an interaction Hamiltonian Hi nt of the form Hi nt = X\X% +X\X\, where X\ and 
X2 are respectively vectors of operators associated with system G\ and G2; see, eg., [45], [24]. We will denote 
the directly coupled system by G\ tx G2, see Fig. [2] 




Fig. 2. Directly coupled system Gi M G2- 
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We note that the independence of the systems G\ and G2 means that operators associated with G\ commute 
with those associated with G2O However, the dynamical evolution of G± will depend on the evolution of G2, and 
vice versa. 

In what follows we take the interaction Hamiltonian to be 

fffnt^^Wl+W), (7) 

where S = A(iK^,iK + ) for matrices K-,K + E c™ 2X ™ 1 . The Hamiltonian for the directly coupled system 

Gi frd G2 is 

H = i?o.i + H^t + Ho,2, (8) 

where H , k = ^a^A(n^\ ^ fc) )aW is the self-Hamiltonian for G k , and H int is given by ©. 

The evolution of the interacting system G\ M G2 is determined by Schrodinger's equation U = —iHU. The 
annihilation operators for G\ evolve according to \t) — U*(t)a^U(t), which leads to the linear differential 
equation 

i^(t)=A , 1 a^(t) + B 12 a^(t), (9) 

with initial condition a (1) (0) = aW, where A ,i = -A(if2^,ifi^), and 

B12 = -A(^_,^+) b . (10) 

Equation (O concerns the evolution of system G\ influenced by the system G2 via the "input" v^(t) = &( 2 )(t) = 
U*(t)a^U(t). Note that the time trajectory t n- v^'(t) is determined as a result of the interaction between the 
two systems. 

Similarly, we see that the evolution of G2 is given by a^(t) = Ao^a^lt) + I?2ifi^(£), with initial condition 

a( 2 )(0) = a<- 2 \ where A , 2 = -A(iftL 2) , ifij 5 ), and 

B 21 = -B{ 2 = A{K_,K + ). (11) 

Of course, Gi M G2 is a special case of the closed systems considered in section III-AI with the interaction terms 
appearing as off-diagonal terms in the overall Hamiltonian when expressed as a quadratic form in and a^ 2 \ 

C. Indirect Coupling via Quantum Fields 

We consider now a system G coupled to a boson field T . Boson fields may be used to interconnect component 
subsystems, effecting indirect coupling between them. While the interaction between the system and field may 
be described from first principles in terms of an interaction Hamiltonian, it is much more convenient to use an 
idealized quantum noise model which is valid when suitable rotating wave and Markovian conditions are satisfied, 
as in many situations in quantum optics, eg., cascaded open systems, see [57], [54], [51], [50] for detail. 

* Mathematically, if the systems Gi and G2 have Hilbert spaces f)i and f)2 respectively, then the interacting system Gi txl G2 is a composite 
system defined on the tensor product space f)i 55 -62- 
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The quantum noise models have a natural input-output structure. The m-channel field before interaction is 
described by bi n (t), the input field, whose components satisfy the singular commutation relations 

[binAt)^* n , k (t')} = 8 jk 8{t - t'), [b ind (t),b in , k (t')) = 0, 

[&Lj(*)> & *n,fc(*')] (j,k = l,...,m). 

The operators bi n j(t) may be regarded as a quantum stochastic process [14, Chapter 5]; in the case where the field 
is in the vacuum state, this process is quantum white noise — a quantum counterpart of Gaussian white noise with 
zero mean. The integrated processes Bi n .j(t) — J Q bi n ,j{T)d,T may be used to define quantum stochastic integrals, 
with associated non-zero Ito products dBi n j(t)dB* n k (t) = Sjkdt. For later use, we define the Ito matrix F by 

m 
I m 

The coupling (interaction) of the system G and the field T is characterized by the vector L of coupling operators 
L = C-ci + C+a# for suitable matrices G_,G+ G C mX ". The Schrodinger's equation for the system G (with 
self-Hamiltonian Ho) and field F is, in Ito form ([14, Chapter 11]), 

dU(t) = ^LdB\ n - l)dB in - (^L + iH )dt\ U(t), 

with £7(0) = /. The annihilation operators evolve according to aj(t) = U* (t)a,jU(t), with Ito dynamics, 

da(t) = (A + A f )a(t)dt + B f dB in (t), (13) 

where A is given by © and A f = -A(T_,r + ), B f = -A(CL,C+) b , and 



Fdt = (dB*(t)dBl(t)) q 



dt. (12) 



T T = ^(clC T -ClC* . (14) 



1 
2 

Equation ( fl~3b may be written in Stratonovich form 

a{t) = (A + A f )a(t) + B f b m (t). (15) 
The output field b out (t) — U* (t)bi n (t)U(t) is given by the equation 

b ut(t) = C f a(t) + b m (t), (16) 

where C f = A(CL, C+). 

Now suppose we have two such systems G\ and G2, specified by self-Hamiltonians Hq and and field 
coupling operators and , respectively. If the output of G\ is fed into the input of system G2 in a cascade 
or series connection, the resulting system is denoted G2 < G\\ see Fig. [3] The system G2 < G\ has Hamiltonian 
H = H { Q 1] + + lm{L^L^} and field coupling operator L = + L^ 2 \ 

In general, the systems G\ and G2 need not be independent, and there may also be terms describing scattering 
among field channels (not considered here), [15]. The construction G2 <Gi is called the series product of the two 
systems, and characterizes indirect coupling between the systems via the field channels. A wide range of quantum 
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Fig. 3. Cascade connection G2 < Gi 



networks may be described using this and a more general linear fractional transformation (LFT) framework. [50], 
[18]. 

In this paper we take G\ and G 2 as independent systems, comprising n\ and ?i 2 oscillators with annihilation 
operator vectors a' 1 ) and a^ 2 ' respectively. The system G 2 < G\ consists of n\ + n 2 oscillators coupled to the field 
F, with dynamics and output given by 

S«(f) = {A Qil +A n )a^{t) + B n b in {t), 

& {2) (t) = (A 0>2 + A f2 )a^(t) + B f2 (C n a^(t) + b in (t)), 

kut(t) = C fl a^(t) + C f2 & (2) (t) + hn(t), (17) 

where all the matrices are determined by the above discussion. Notice the asymmetry in ( fTTI i, where a^ 2 \t) has 
no influence on a^(t), in contrast to the symmetry evident in the equations for G\ \xi G 2 given in section ITT-Bl 

D. A More General Model 

We now present a more general model for an open system G with specified mechanisms for direct and indirect 
couplings, based on the ingredients discussed in the preceding sections, Fig. Q] Our interest is in the influence of 
external systems on the given system. The performance characteristics of interest are encoded in a performance 
variablt\ z. 

The equations for G (including external couplings and performance variables) are 

h{t) = Aa{t) + B d v{t) + B f w(t) + B f b in (t), (18) 
kut{t) = C f a{t) + w(t) + b in (t), (19) 
z(t) = C p a(t) + D pd v{t) + D pf w(t), (20) 

The complex matrices in ( TT8l and $1% are given by 

A = -A(iO_,ffl + ) - A(T_. B d = -A(K-,K + )\ (21) 
B f = -A(C-,C+)\ C f = A(C-,C+), (22) 

t A performance variable is chosen to capture some aspect of performance, such as an error quantity, and so may involve external variables, 
like a reference signal. Performance variables need not have anything to do with the output quantities associated with direct or indirect couplings 
to other systems. 
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where r± is given by (TBl i. The matrices A and Bf are specified by the parameters f2±, and C±. In equations 
( fTST l and ( fl9l i, 6j„ and 6 out are respectively, the input and output fields for G. The term v in ( TT~8b is an exogenous 
quantity associated with another (independent) system Wd with which G is directly coupled via the interaction 
Hamiltonian 

H int = X - (tfS^v + tfSa) , (23) 

where S = A(iK-,iK+). The matrices K± determine Bd- The term w in < fT~8T > is another exogenous quantity 
associated with another (independent) system Wf with which G is indirectly coupled through a series connection. 
Because of the assumed independence, w and v commute with the mode operators aj , a* for G. While v and 
w are arbitrary external variables, the time evolutions v(t) and w(t) are determined by the evolution of the full 
interacting system. Indeed, G is a subsystem of the system (Go ixi Wd) < Wf, where Go is an oscillator coupled 
to the fields. Equation (TT~8T > gives the evolution for the oscillator variables in Go- The matrices C p , D p d and 
D p f are used to specify the performance variable z. The complete system G is specified by the parameters G = 
(fl±, C±,K±, C p , D p d, Dpf). Of these, fi±, G± and K± are physical parameters. 



E. Quadrature Representation 

So far, we have used the annihilation and creation operators aj , a* to represent oscillators systems, using the 
doubled-up notation a = [a T a^] T . This annihilation-creation representation results in equations with complex 
matrices. There is an alternative quadrature representation, which results in equations with real matrices; these may 
be more convenient for standard matrix analysis software packages. 

Define the unitary matrix 



A = -P 



and the vector 



of self-adjoint operators by the relation 



I I 

-il il 



q 
p 



a = AS. 



(24) 



(25) 



(26) 



The vector q= -^=[1 1]a is known as the real quadrature, while p = -^[— H iJ]a is called the imaginary or phase 
quadrature. Since A is unitary, equation (|26| | is invertible: a = A* a. 

Now let Af, Ad and A p be unitary matrices, of suitable dimension, of the form (|24] |. and define the following 
quadrature vectors bi n — Afbi n , b ou t = Afb ou t, w = A fib, v = Adv, z = A p z. Then in quadrature form G is given 



by 



5(t) = Aa(t)+B d v(t)+B f w(t) + Bfb in (t), 
b ut(t) = C f a(t) + w(t) + b in (t), 

z(t) = C p a{t) + D pd v(t) + D p fw(t), 
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where A = AAA\ B d = AB d A\, B f = AB f A f , Cj = A f C f A\ C p = A P C P A\ D pd = A p D pd A d , D pf = 
ApDpfA^. Note that all entries of the matrices in this representation are real. 

F. Physical Realization 

The matrices in equation d2TT>-(f22T> for the general linear quantum system G of section |H-Dl have special structure, 
and therefore form a subclass of the class of linear dynamical models. When designing a quantum linear system, 
as in coherent feedback design, it is important to know when a linear dynamical system corresponds to a quantum 
linear stochastic systems. This is a fundamental question of physical realization, [20], [29], [30], [33]. In this section 
we present an additional relation that characterizes the preservation of commutation relations ([a,-(i), o,^(t)] = Sjk 
for all t) which is fundamental to physical realizability. 

In the doubled-up notation, the commutation relations may be expressed in the form 

[aj,a%] = (J n )jk- (27) 

Now it is straightforward to verify that for the matrices A and C* defined in section Hl-DI we have 

A + A b +C)C f = 0. (28) 

By multiplying (f28j) by J„ on the left, and using the above definitions we see that the following fundamental 
relations for the matrices in the general model G of section IH-DI hold: 

J n A + AU n + Cp m C f = 0, (29) 
B f = -C), (30) 
B d = -&{K_,K+f. (31) 

Equation ( 1291 characterizes preservation of the commutation relations, and moreover, the relations (1291 -PTTl gener- 
alize the canonical physical realizability criteria in [20, Theorem 3.4], [27, Theorem 5.1], [33, Theorem 3], 

III. Performance Characteristics of Systems with Direct and Indirect Interactions 

The purpose of this section is to discuss basic performance characteristics such as stability, passivity, gain, etc. 
for linear quantum systems, using the models developed in section [TT] 

A. Stability 

Perhaps the most basic performance characteristic is stability. In the case of a system G based on quantum 
harmonic oscillators, stability may be assessed in terms of the behavior of the number of quanta (e.g. photons) 
stored in the system, N = a^a — X)j=i a *j a r With zero inputs but possibly coupled to vacuum fields, that is, 
w = and v = in ( fT8l . we will say that G is exponentially stable if (N(t)) < coe~ Clt (N) + for some 
cq > 0,ci > 0, and C2 > 0, (ii) marginally stable if (N(t)) < ci(N) + C2t for some c\ > and C2 > 0, and 
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(iii) exponentially unstable if there exists an initial system state such that (N(t)) > coe Clt (N) + C2 for some real 
constant c > 0, c\ > and c%. 

For example, for the closed systems studied in Sec. IH-AI if £1 + = we see that a(t) — exp(— i£l-t)a, and 
a^(t)a(t) = a^a for all t, which means that G is marginally stable but not exponentially stable — it oscillates — hence 
the name "oscillator". 

The total number of quanta N = a^a is a natural Lyapunov function for G, and is directly related to the energy 
of the system. In what follows we find it is more convenient to use 



V = —a'a — a' a H , 

2 2 



(32) 



which differs from the total number of quanta by an additive constant. More generally, we will consider storage 
functions of the form V = ^a^Pa for non-negative Hermitian matrices P. 

The following result is a simple criterion for stability of system G defined in section III-DI 

Theorem 1: If there exist P > and Q > cP for a scalar c > such that 



then 



A^P + PA + Q < 0, 



(a f (t)Pa(t)) < e~ ct (a* Pa) + 



2c' 



(33) 



(34) 



where A = ti[B 1 f PBfF], and F is defined by O- If also P > al (a > 0), then we have (d{t)a(t)) < 
±e- ct (a)Pa) + 

a \ I 2ca 

The proof of Theorem Q] is similar to that in [19], so is omitted. 

As an example, for the closed systems studied in Sec. IH-AI in the special case of n = 1, 51- = 0, + = ie/2, 
with e real, the rate of change of energy is |((a*) 2 + a 2 ) and the matrix \{A + Aq) has eigenvalues ±e. Also, 
^A(Aq + AI ) )A^ 1 = diag(e, — e), which means that the real quadrature expands, and the phase quadrature contracts — 
this is the basic "squeezing" action, as in a degenerate parametric amplifier (a realistic model would also include 
damping, see section Hll-F.31 >. Therefore the stability of the closed system G depends on 51 + . 



B. Dissipativity of Linear Quantum Systems 

We now consider the general class of open systems G defined in section III-DI In order to simplify the notation 
we write u = [v T w T ) T for the doubled-up vector of external variables, and define accordingly 

7 
0/0 
0/00 
/ 

where dimensions of identity matrices are implicitly assumed to be conformal to those of v and w. The dynamical 
equation ( f]~8T > becomes 

h(t) = Aa{t) + Bu{t) + B f b in (t). (35) 



B := [B d B f ] 
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In order to define dissipation for G, we use the supply rate 



r(S, u) = —[<$ u^]R 



a 
u 



(36) 



R = 



(37) 



where R is a Hermitian matrix of the form 

Rn R12 

Given a non-negative Hermitian matrix P, we define a candidate storage function V = In what follows 

we will need the relation 



E a [V(t)] 



(38) 



E s [o){t)(PA + Atp)a(r) 

+v) (t)B^ Pcl{t) + ^(t)PBu{t) + tr[B\PB f F]]dr 

for s < t, where the matrix F is that defined in (fTSl i. and the notation E s is used to denote the operation of 
averaging out the quantum noise in the field channels from time s onwards, c.f. [31, page 215]. 

Definition 1: (Dissipation) We say that the system G is dissipative with respect to the supply rate r(a, u) (given by 
(|36T >) if there exists a non-negative Hermitian matrix P and a non-negative real number A such that for V = ^a^Pa 
we have 

E [V(t)]<V + E {[ r(a(T),u(r))dT]+Xt (39) 
Jo 

for all i > and all external variables u and all Gaussian states for the systems and fields. (Recall that V(0) = V 
defined in Eq. d32l.) 

As in [20, Theorem 4.2], the dissipativity of G may be characterized in terms of a linear matrix inequality(LMI). 
Theorem 2: (Dissipation) The system G is dissipative with respect to the supply rate r(a, u) (given by d36i >) if 
and only if there exists a non-negative Hermitian matrix P such that 

PA + A^P - R u PB - R X2 



b*p-r\ s 



< 0. 



(40) 



Moreover, A = tv[B\PB f F]. 



The proof of this Theorem is similar to that of [20, Theorem 4.2] and will not be given, except to say that it 
involves combining the relation (l38l and the inequality 



C. Positive Real Lemma 

In this section, we study passivity for linear quantum systems presented in Sec. IH-DI Taking Rn = —Q, 
R12 = CJ, R 2 2 = 0, and a performance variable z — C p a, the supply rate r in (|36T l becomes 

r(a,u) = -(-a^Qa + ifiz + z^u) (41) 
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Definition 2: (Passivity) We say that a system G of the form (1351 1 with a performance variable z is passive if 
and only if it is dissipative with respect to the supply rate defined in (|4TT > with Q being non-negative. 

Passivity can be checked using Theorem |2] In fact by Theorem |2] we have the following version of the positive 
real lemma. 

Theorem 3: (Positive Real Lemma) The system G with performance variable z = C p a is passive if and only if 
there exist non-negative definite Hermitian matrices P and Q such that 

PA + A^P + Q PB-Cl 



B^P - C v 







< 0. 



(42) 



Moreover, A = tr[B\PB f F ]. 

We now discuss the natural passivity property for the system ( [35) , along the lines of [19, section HI.A.]. Let 
V = ^a^a, and note that the LMI ( l42b from Theorem [3] is satisfied with equality when P — I, C p — B\ and 

Q = -(A + A f ) = A{C+C- - ClC*, 2*n + ), (43) 

which is not necessarily non-negative. Consequently, passivity with respect to the performance variable z = B^a 
will depend on the definiteness of Q. Interestingly, define M — M_a + M + a#, where 

K± 



M± = 



C± 



(44) 



Then it is easy to show that the performance variable z can be written as the commutator z = [V, M] . 

Remark 1: In the special case of no direct coupling, with u = w, B = Bf, we have C v = Bj, whereas 
Cf — —B^. In general, C p ^ Cf, which means that the performance variable z does not form part of the field 
output. However, when B satisfies the invariance condition B = JBJ, namely C+ = 0, we have C p = —Cf and 

kut{t) = -Z(t) + W(t) + b in (t). □ 



D. Bounded Real Lemma 

Theorem |2] may also be used to characterize the L 2 gain property, as discussed in [20], [27], [33]. Here we 
summarize the main points using the framework developed in this paper. Our interest is in the influence of the 
external systems Wd and Wf on the performance variable z, given in the general model by equation d20b . in the 
sense of L 2 gain. 

Using the notation D p = [D p( i D p f], the performance variable is given by z = C p a + D p u. The dynamical 
evolution is given by (l35l >. Define a supply rate 



r(a,u) = --(tfz- g 2 u f u), 



(45) 



where g > is a real gain parameter. This corresponds to the choice i? u = — C^C p , R\ 2 — —C^D p , i? 2 2 = 



g 2 - D\D p . 



Definition 3: (Bounded realness) For the system G of the form d35l > with performance variable z = C p a + D p u, 
we say the transfer u H> z is bounded real with finite L 2 gain less than g if the system is dissipative with respect 
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< 0. 



(46) 



to the supply rate defined in d45l l. If the gain inequality holds strictly, then we say the transfer u M> z is strictly 
bounded real with disturbance attenuation g. 
From Theorem |2 we have: 

Theorem 4: (Bounded Real Lemma) The system G with performance variable z — C p a + D p u is bounded real 
with finite L 2 gain less than g if and only if there exists a non-negative Hermitian matrix P such that 

PA + A^P + C$C P PB + C^Dp 
Ptp + jD t<- D\D p -g 2 l 

Moreover, A = ti[B f f PB f F]. 

In the special case C+ = 0, £1+ = 0, no direct coupling, C p = Cf, and D p = I, we have z = C p a + w and 
bout — z + bi n . In this case, the LMI d46l ) is satisfied with equality for P = I and g = 1, which means that the 
gain of the transfer w i— > z is exactly one for such systems. This corresponds to the lossless bounded real property 
discussed in [27], and shown to be equivalent to physical realizability for this special class of systems. In general, 
however, physical realizability and the lossless bounded real properties are distinct (see, e.g. section |TlI-F.3| >. 

As in [20], the following version of the strict bounded real lemma may be proven. 

Theorem 5: (Strict Bounded Real Lemma) The following statements are equivalent. 

i) The quantum system G defined in (fT~8T> - d20b is strictly bounded real with disturbance attenuation g. 



ii) 



A is stable and 



C p (sl-A) 1 B + D t 



< 9- 



iii) g 2 I — D p D p > and there exists a Hermitian matrix Pi > satisfying inequality 

A^P l +P l A 
B^P l + DlC p 



CjCp P x B + ClD p 



DiD p - g 2 I 



< 0, 



(47) 



or, equivalently, 



AtPi + PiA I\B Cl 



Ptp x 



-gi Dl 



C p D p -gi 



< 0. 



(48) 



iv) g 2 I — D p D p > and there exists a Hermitian matrix P2 > satisfying the algebraic Riccati equation 

Atp 2 + P 2 A + (P 2 B + Cj£> p ) 
x(g 2 I-DlD p y 1 (B^P^+DlC p ) 
= 

with A + BB^P-2 being Hurwitz. 
Furthermore, if these statements hold, then Pi < P 2 . 



E. LQG Performance 

In this section a quantum LQG cost function is defined in the annihilation-creation form, and whose evaluation 
is connected to a Lyapunov equation in the complex domain. 
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Consider the following quantum system 



da(t) = Aa(t)dt + B f dB m (t) 



(49) 



where Bi n {t) is a quantum Wiener process introduced in section Ifl-Cl Given a performance variable z(t) — C p a(t), 
define a finite-horizon LQG cost function to be = f f (z^ (t)z{t))dt for arbitrary tf > 0. Along the line of 

[29], the infinite-horizon LQG cost is 



] iu) 1 ( 1 I (z\t) 'z{t) + z T (t)z* (t)) dt 



tf— too tf Jq 2 



lim i [ f Tr{C p P LQG (t)Cl}dt 
Tt{C p P lqg CI}, 



where the constant Hermitian matrix Plqg satisfies the following Lyapunov equation 

APlqg + PlqgA^ + \B f B) = 0. 



(50) 



(51) 



F. Examples 

In this section we use several examples to illustrate the stability, passivity and finite L? gain properties discussed 
in the preceding sections. 

1 ) Oscillator with Directly-Coupled Disturbance: Let the system G be an oscillator (no field connections) directly 
coupled to an external system Wd via an interaction Hamiltonian Hi nt — i^f(v*a~ a*v). That is, 0_ = w, fl + = 0. 
C_ = 0, C+ = 0, K- = 7, K + = 0. This system evolves according to a = —iuja — -fv, so that for V = a* a we 
have V — ~^v*a — ^a*v. Hence G is passive with respect to the performance variable z = —ja. 

2) Optical Cavity: An optical cavity G is a single open oscillator [16] with 0_ = uj, Cl + = 0, C_ = y/H, 
C+ = 0, that is ([16, section IV. B.]), 









where w arises from indirect coupling to an external system Wf via the input field. 

As in section ITH-DI choose a performance variable z = y/nd + w. According to the discussion in section UlI-DI 
G has L 2 gain 1. Moreover, since Q = A ^ClC_, 2itt + ^J =[k 0;0k]> 0, following the development in section 
IIII-C1 G is exponentially stable and passive with respect to the performance variable z — —^/nd. 

3) Degenerate Parametric Amplifier: A degenerate parametric amplifier (DPA) is an open oscillator that is able 
to produce squeezed output field. A model of a DPA is as follows ([14, page 220]): 



k —e 
—e k 
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Here, we have included the term w which arises from indirect coupling to an external system Wf via the input 
field. For this system, = 0, fi+ = § , C_ = y/n, and C+ = 0. Now 



Q = A( K ,-e) 



k — 7 , 



w + hi 



k —e 
— e k 

and so Q > if and only if e < k. So the DPA is passive with performance variable z = —yJHa if and only if 
e < k, i.e., if and only if it is marginally or exponentially stable. 

When e < k, the L 2 gain from w to z 2 — y/Tia + w is (k + e)/(k — e). This system is not lossless bounded real, 
but satisfies the physical realization criteria of section HI-FI 

4) Optical Amplifier: A model for an optical amplifier G is given in [14, page 215], which corresponds to a 
single open oscillator with f2_ = 0, ft + = 0, C_ = yJH, C+ = ^/j: 

where we have included the term w which arises from indirect coupling to an external system Wf via the input 
field. For this model we have Q — (k — 7)/, and so G is exponentially stable if 7 < k, and marginally stable if 
7 = k. Consequently, G is passive with performance variable 

\[k -\/7 

_ -a/7 
if and only if 7 < k. 

Finally, when the system G is exponentially stable, the L 2 gain of the transfer w — > Z2 = yJHa + w is (k + 7 + 
2 V^7)/( K_ 7)- 

5J Effect of Direct Coupling on H°° Performance: Consider two quantum systems G\ and G2 given by 

di(t) = -8oi(t)-4w 1 (t)-46 i ^i(t), 

b ut,i(t) = 4ai(t) +wi(t) + b in ,i(t), 

a 2 {t) = -2a 2 (t)-2w 2 (t)-2b m , 2 (t), 

&out,a(t) = 2a 2 (t) + 102 (*) + bi 7li2 (t). 

Clearly, in both systems C+ = 0+ = f2_ = 0. We suppose that these systems are directly coupled via a coupling 
of the form (0, with if _ and K + being real. 

If K + = 0, the term of the composite system is zero (c.f. (Q]i)- Consequently, by the discussion in section 
IIII-DI the H°° norm from Wi to z\ = 4&i + wi is 1. Next, fix the ratio K + /K_ to be 3. Then the i 2 gain from 
wi to z\ is plotted as a function of Jf _ in Fig. |4] Clearly, this type of direct coupling indeed influences the L 2 
gain of the first channel of the system G. 
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Fig. 4. L 2 gain of the transfer wi — > z\ in the example of section ITlI-F.51 as a function of K- for fixed ratio iC+ = 3K-. 

6) Effect of Direct Coupling on LQG Performance: Given a linear quantum system 

di 0) = -0.0187ai(t) - 0.19346 in ,i(t), 

a controller 

a 2 (t) = -0.2327a 2 (7j) - 0.68226 in , 2 (t), 

and a performance variable 

Zx(t) = ai(t), 

in this section we show how direct coupling of the form (O can influence the infinite-horizon LQG cost defined as 
Zoo in (1501 , For simplicity of exposition, assume both and K + are real numbers. Fix K + = 0, the LQG cost 
Zoo is plotted as a function of K- in Fig. [5] Note that even when K + = 0, Zoo is affected by direct coupling. Fix 
K + /K- = 1.1, Zoo is plotted as a function of K- in Fig. [6] These two examples clearly show that direct coupling 
is able to influence LQG performance specified for the plant. 

IV. Coherent Feedback Controller Synthesis 

So far we have looked at some basic performance characteristics of linear quantum systems (stability, passivity, 
gain), and in particular we have seen how direct coupling can influence behavior. In this section we turn to the 
problem of including direct couplings in systematic controller design methodologies. Using direct couplings in 
design is natural from the physical point of view, and has been considered in [24]. Our interest here to design direct 
and indirect couplings to optimize specific performance criteria. In general, explicit solutions are not known, and 
optimization algorithms are used. 

We begin in section IIV-AI with a description of the plant-controller feedback system to be used in the sequel. In 
section IrV-B I we give a brief example to illustrate how direct coupling may be used to stabilize an otherwise unstable 
closed-loop system. Sections IIV-CI and IIV-DI extend the H°° and LQG coherent controller synthesis methods of 
[20] and [29] respectively to include direct couplings. 



May 10, 2011 



DRAFT 



18 



1 

0.9 
0.8 

jo, 
5 

0.5 
0.4 

-0.1 -0.08 -0.06 -0.04 -0.02 0.02 0.04 0.06 0.08 0.1 

K_ 

Fig. 5. LQG performance for the example of section ITlI-F.61 as a function of K— while K+ = 0. 
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Fig. 6. LQG performance for the example of section ITlI-F.61 as a function of K- with fixed ratio K+ = 1.1K-. 

A. Closed-Loop Plant -Controller System 

Consider two quantum linear systems: P, the plant to be controlled, coupled to K, the controller, as shown in 
Figure [7] This feedback system involves both direct and indirect coupling between the plant and the controller. 
While the feedback architecture will be fixed, the parameters defining the controller (which includes the couplings) 
will be synthesized using H°° and LQG performance criteria. 

The plant P is given by differential equations 

h(t) = Aa{t) + B 12 a K (t)+B v b v {t) + B f w(t) 

+B f b m (t) + B u u(t), 8(0) = a , 

y(t) = Ca(t) + D v b v {t)+D f w(t)+D f b m (t). (52) 

The inputs w(t) and 6j n (t) are the same as defined in section llTCl y(t) is a selection of output field channels from 
the plant. b v (t) is a vector of additional quantum noises; u(t) is a quantum field signal from the to-be-designed 
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Fig. 7. Coherent feedback control arrangement. 



controller K, hence it is a vector of physical variables. The term B12&K (t) are due to direct coupling which will 
be explained shortly. 

A fully quantum controller used in this paper is a linear quantum system of the fornjj] 

h K (t) = A K a K (t) + B 21 a{t) + B K y{t) + B K1 b VK1 (t) 
+B K2 b VK2 (t), a K (0) = &ko, 
u(t) = C K a K (t) + B K0 b VK1 (t). (53) 

This structure allows for direct coupling and indirect coupling between the plant P and the controller K. Here, 
b VK1 (t) and b VK2 (t) are independent standard quantum white noises, and u(t) is the field output of the controller 
corresponding to b VK1 (t). Hence, Bko is a square matrix; in fact, it is an identity matrix. Finally the terms -Bi.2&K"(i) 
and £>2ia(£) is due to the direct coupling between the plant and controller in terms of an interaction Hamiltonian 



H 



PK 



- (a^S^&K + a f K Sa^J , 



(54) 



where S — A(iK~,iK+) for complex matrices K- and K + of suitable dimensions. 
The overall plant-controller system, including direct and indirect couplings, is 







a K (t) 





A B u Ck + B12 

BrC + B21 Ak 



a(t) 
a K (t) 



B K D f 



w(t) + Gd 



hn(t) 

k(t) 

b VK2 (t) 



(55) 



*We assume that all the variables and matrices of the plant and the controller have compatible dimension, but we don't bother to specify 
them explicitly. 
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where B12 and B21 are given by (TTOb and ( fTTT i respectively and 



G c ; = 



B f 



B„ 



B u Bko 



BjcDf BkD v Bki Bk2 
The controller matrices K-,K + , (or -Bi2,£?2iX Ak,Bk,Gk,Bk\,Bk2,Bko are to be found to optimize 
performance criteria defined in terms of the closed-loop performance variable 

a(t) 



m = K D U C K ] 



+ D pf w(t). 



(56) 



a K {t) 

Because standard matrix algorithms will be used in what follows, we may represent the plant-controller system in 
quadrature form as discussed in section III-El Let a, (xk, vj, bin, ^tii u, z, y, b VK1 , b VK2 be the quadrature counterparts 
of a, clk, w, bin, b v , z, [3 U , y, b VK1 , b VK2 respectively. Define 



A B U C K 
B k C A k 



5, B c i = 



Grl — 



B 



B r 



Bf 
B K Df 

B u Bko 



BKDf BkD v Bki Bk2 



Cd — 



C p D U C K , D d = D pf , 



where 5 = [0 B12; B21 0] satisfies B21 = OBf 2 Q- Then the closed-loop system in the quadrature representation 
is given by 

b in {t) 



5(t) 
a,K(t) 



A r 



a(t) 
a,K(t) 



B cl w{t) + G c 



b v (t) 
k K2 (t) 



m = c cl 



a(t) 
a K {t) 



D ci w(t). 



Remark 2: Since Bko is an identity matrix, Bko — I- Note that the coefficient matrix of dvK in [20, Eq. (23)] 
is in fact [/ 0] because vk = [vki V K2\ T k usec ^ th ere - O 



B. Stabilization 

The following example shows that an appropriate direct coupling is sufficient to stabilize an unstable closed- 
loop system formed by indirect coupling via field channels. The example is constructed in the following way: Let 
fi_ = and 57 + — for both the plant and the controller. Then for fixed CL, choose C+ for both the plant and 
the controller such that each of them is stable while the closed-loop system is unstable. Finally find parameters K_ 
and K + of direct coupling such that the closed-loop system is stable. The example is of illustrative nature, with 
no practical intention. 
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Consider a quantum linear feedback system as in Fig. [7] where the quantum plant is given by 

-0.3420 0.2897 



a(t) = -0.1331a(i) 



0.2897 



-0.3420 



bin(t) 



-0.8180 0.6602 
0.6602 -0.8180 



»(*), 



m = 



0.3420 0.2897 
0.2897 0.3420 



a{t) + b in {t). 



Here, y(t) is the field output corresponding to bi n (t). The indirect coupling is given by 

-0.7271 0.3093 



a K (t) 



-0A321a K (t) 



-0.3412 0.5341 
0.5341 -0.3412 



0.3093 -0.7271 

VKl(t), 



m = 



a K {t) +v K i{t). 



(57) 



(58) 



0.3412 0.5341 
0.5341 0.3412 

That is, u(t) is the field output of K corresponding to VKi(t). It can be shown the closed-loop A-matrix is not 
Hurwitz despite the fact that both of the A-matrices of the plant and the controller are indeed Hurwitz. 

Now if the direct coupling is specified by K_ = —0.6 and K + = —0.42, it can be verified that the new 
closed-loop A-matrix is Hurwitz. 



C. H°° Synthesis 

In section IIII-F.5I a simple example shows that direct coupling can influence the L 2 gain of channels in linear 
quantum systems, and the purpose of this section is to include this additional design flexibility into the H°° 
synthesis methodology of [20]. Before going into the more general set-up, let us first illustrate how to design direct 
and indirect couplings to affect the input-output behavior of a given quantum plant. 

1) A Simple Example for H°° Synthesis: Consider a quantum plant of the form 

a(t) = -2 a W ~ V%( M 1W + bin,iw) - \/^2 & m,2(£), 
z(t) = V / K^a(t), a(0) — a, 7 = Ki + k 2 . 

Here, the disturbance wi is an external variable entering the first field channel, while the performance variable z 
is a component of the output of the second field channel b ut,2(t) — z(t) + &-j n ,2(i). 

We assume the indirect coupling is an open optical cavity interacting with one field channel 

aic(t) = {-iu - -^-J a K {t) - ^/i^b VK1 (t), a K {0) = a Kl 
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where w and K3 are real. Adding a particular direct coupling of the form (0 where S — A (iK-, 0) with if_ being 
real for simplicity, then the closed-loop system is (in the quadrature representation) 



5(0 
a K {t) 

m 



-|o(i) - K-h K {t) 



—y/^l (*l(f) +^m,l(f)) - A/«2*tn,2(t), 
= y/~K2a(t) + b in ,2{t), 



where Ox = [0 1; — 1 0]. The closed loop system matrices are 





' -V -K-I 






A d = 




, B c i — 












C c 



, D cl = 0. 



We now seek to minimize the L 2 gain of the transfer ivi — > z with respect to the direct coupling parameter K_. 
Fix Ki = 2, K2 = 5, and K3 = 3. Without direct coupling, the L 2 gain is 0.9035. Note that the unknown variables 
are real numbers oj (for indirect coupling) and if_ (for direct coupling). Matlab function 'fminsearch' yields a 
local minimal value of the L 2 gain 0.6284 at oj = and K- = 17.7135. 

Remark 3: If K3 goes to 00, it can be shown that the L 2 gain approaches 0. The physical reason for this is that 
when K3 is large, the coupling of the controller to the controller field channel is strong, and energy entering the 
first field channel exists via the controller output channel. □ 

2) LMI Formulation: The preceding section shows that certain simple optimization functions can be used to 
design direct couplings to alter the input-output behavior of quantum plants. In the section we present a general 
formulation using LMIs. 

According to the strict bounded real lemma (Theorem[5]l, the closed-loop is internally stable and strictly bounded 
real with disturbance attenuation g if and only if there is a real symmetric matrix V such that 



V > 



Aj,V + VA cl VB C 



-gl D T 



1 

fjl 



< 0. 



(59) 
(60) 



Cd D c i 

In what follows controller parameters Ak, Bk, Ck and direct coupling parameters S are derived based on a 
multi-step optimization procedure. Observe that inequality d60t is nonlinear, a change of variables technique is 
proposed in the literature to convert it to linear matrix inequalities [32]. We outline this technique briefly. Following 
the development in [32], decompose V and its inverse V~ l as 





Y N 




X M 


V = 




, v~ x = 










M T * 
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X 


I 




i 


Y 


III = 






, n 2 = 








M T 













Define 



And also define a change of variables 

A = N(A K M T + B K CX.) + Y{B U C K M T + AX), 
B = NB K , 
C = C K M T , 

o = nf-psHi. 

With these notations, (lo*0l i holds if and only if the following inequalities holds. 

X I 



I Y 



<0, 



ix + Xi T + B U C+{B U C) T 
A+A T 

U ^ 

i + A T 
i T Y + YA + BC + {BC) T 

(YB f + BD f f -gl 

C p D c i -gl 

B 12 M T + (B 12 M T ) T (NB 21 X) T + (YB 12 M T ) T 
NB 21 X + YB 12 M T NB 21 + (NB 21 ) T 











(61) 



(62) 



< 0. 



(63) 



If d62l ) and d63b are simultaneously soluble, then a controller and the interaction Hamiltonian can be obtained. More 
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specifically, according to Eq. doTt . the following matrices can be obtained: 



B K 



(64) 



A K 



C k 



C(M T y\ 

N-^A-NBkCX - Y(B U C K M T + AX))M 

v- 1 (il; t ) rar^ 1 . 



—T 



(65) 



Unfortunately, notice that there are such terms as A£>2iX and YBi2M T in inequality d63l l. which make it still 
nonlinear. The above analysis shows it is hard to directly utilize LMI techniques to do controller design when direct 
coupling is involved. 

3) Multi-step Optimization: In this section, we intend to circumvent the above difficulty based on a multi-step 
optimization procedure which is formulated as follows: 

Initialization. Set B12 = and B21 = 0. 

Step 1. Employ LMI techniques to solve linear matrix inequalities d62l i and d63l l. Then choose matrices M and 
N satisfying MN^ 1 = I — XY. With these parameters, indirect coupling parameters parameters Ak, Bk, and 
Ck are obtained via ( |64l . 

Step 2. Pertaining to Step 1. Solve inequalities in (|63l to find direct coupling parameters B12 and disturbance 
gain g. 

Step 3. Fix B12 and B21 to those obtained in Step 2 and fix M and N obtained in Step 1, restart from Step 1 
to find parameters A, B, C, X, Y, and disturbance gain g. Then go to Step 2. 

After this iterative procedure is complete, use the values B12, B21, Ak, Bk, Ck obtained to find Bki, Bk2,Bko 
to ensure physical realizability of the controller (see section ITV-C.41 for details). 

Remark 4: Steps 1 and 2 are standard LMI problems which can be solved efficiently using the Matlab LMI 
toolbox. However, there is some delicate issue in Step 3. Assume that B 12 and B 2 i have been obtained in Step 
2. According to the second item in (l63l l. constant matrices M and N must be specified in order to render ( f63T > 
linear in parameters A, B, C, X, Y, and disturbance gain g. In Step 3, M and obtained in Step 1 is used. 
Unfortunately, this choice of M and N sometimes may generate a controller whose parameters are ill-conditioned. 
Due to this reason, M and N in Step 3 might have to be chosen carefully to produce a physically meaningful 
controller. This fact is illuminated by an example in Section IIV-C.6I 

4) Physical Realizability: Because the to-be-designed controller is fully quantum, its dynamical evolution must 
obey laws of quantum mechanics, as a result controller parameter matrices cannot be chosen arbitrarily. This is 
the so-called physical realizability (of fully quantum controllers) as discussed in section HI-FI In this section we 
investigate this issue in more detail by focusing on the structure of the controller ( [53b . Firstly, direct coupling 
demands equalities ( fTOb and (TTTT) for certain matrices K- and K+ for an interaction Hamiltonian Hpk defined in 
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(|54| |. Secondly, equations d29b-(T30b for indirect coupling can be rewritten as 

J n A + AU n + (b^ J m B) = 0, (66) 

C f = -B). (67) 

Since the input of the quantum controller (l53l l is partitioned into three blocks, it is better to rewrite the above 
relations as 

Ju k Ak + A K J nK + (B K1 )^ J mi B K1 

+ ( b k) Jm 3 B* K = 0, (68) 
C K = -B K1 , (69) 
B K0 = I. (70) 
Similarly, in the quadrature representation the controller is physically realizable if and only if 

A-K&riK + Qn K A K + BkiQuuBki 

+BK2Q m2 Bx2 + BK@m 3 B K = 0, (71) 

CfC — ©mi BjCl ®riK ) 

Bko = I 
B21 — @njr-Sl2©n- 

hold, where the subscript n is the dimension of ait), and B12 is an arbitrary matrix. 

The issue of physical realizability of indirect coupling has been addressed in [20] (see, e.g., [20, Theorem 5.5 and 
Lemma 5.6]), where it is shown that, for arbitrarily given Ak, Bk, and Ck, there always exist Bki, Bk2, and Bko 
such that the resulting indirect coupling is physically realizable. Noticing the fact that unitary transformation defined 
in section ITI-El is equivalent to the transformation in [20, section III. A.] in terms of similarity transformations, it is 
easy to show that controllers designed via the multi-step optimization procedure can be indeed fully quantum. The 
procedure goes like this. Firstly, after step 1 is implemented, a similar technique like that in [20, Lemma 5.6] can 
be used to obtain an indirect coupling which is physically realizable. Second, after step 1 is implemented, B12 is 
obtained. Let B21 = Qn K Bf 2 l dn- Then a direct coupling is constructed. Clearly, the quantum controller composed 
of the indirect coupling and direct coupling is physically realizable. Finally, since direct coupling does not affect 
indirect coupling, Steps 3 can always yield a physically realizable indirect coupling. Consequently, the multi-step 
optimization procedure indeed is able to produce a fully quantum controller. 

5) Example 1: In this section, an example is studied to demonstrate the effectiveness of the multi-step optimization 
approach proposed in the preceding section. Interestingly, due to the special structure of matrices, a physically 
realizable quantum controller can be constructed directly, without going through a procedure like that in [20, 
Lemma 5.6]. 
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The following optical cavity system is studied in [20]. 



d(t) 
a*{t) 

Ba(*) 



7 



a*(i)-^T^(t) 



K 3 a(t) + A a (t), 

7^a{t) + A 2 (t), a(0) = a, a*(0) = a* 



where 7 = ki + K2 + K3. Ki, «2, and k 3 are coupling coefficients. In our notation, A\(t), A<2(t), A 3 (t), B2(t), 
and B 3 (t) correspond to b v (t), w(t) + bi n (t), u(t), y(t), and z(t) in the formulation outlined in section ITV-AI 
respectively. The control problem studied in [20] is to minimize the influence of A 2 (i) on B 3 (t). In what following 
we investigate robustness of the control system. Let k\ = 2.6, n 2 — n 3 = 0.2. Suppose there is no direct coupling. 
Fix g — 0.1. Then solving d62l and d63l > yields an suboptimal controller with parameters Ak = —3.0803/, 
Bk = 0.6801/, and Ck = 0.5180/. This controller provides a disturbance attenuation level 0.0487. Now suppose 
the optical cavity parameter K\ suffers from uncertainty [7]; for example, its effective value is 1.3, instead of 2.6, 
then the original controller yields a disturbance attenuation level 0.1702, a significant performance degradation. 
Adding a direct coupling can improve this situation. In fact, by implementing step 2 in the multi-step optimization 
approach proposed above, direct coupling matrices 



B\2 — 



0.1648 
4.1842 



-4.1842 
0.1648 



, B21 



-0.1648 -4.1842 
4.1842 -0.1648 



are obtained. With such direct coupling the resulting disturbance attenuation level is 0.0618, which is close to the 
original 0.0487, a significant improvement over that involving indirect coupling solely. Finally, assume y first passes 
through a 180° phase shifter (e l7r ) before it is sent to the controller, then the physically realizable controller (in the 
annihilation-creation representation) is given by 



+4.1842i 



a(t) - Q.6801#(t) 



h K (t) = -3.08035x0) - 0.1648o(i) 
1 
-1 

-0.51806„ K1 (» - 2.33026„ K2 (t), 
u(t) = 0.5180a K (t) + b VK1 (t), a K (Q) = a K o- 

6) Example 2: In what follows the example discussed in [29] is re-studied to demonstrate how to use a technique 
similar to that in [20, Lemma 5.6] to yield a physically realizable quantum controller. 
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Consider a linear quantum plant described by a set of quantum stochastic differential equation 



fi(t) 



fl 
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a(t) = 
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(72) 



where A = 0.4, fci = &2 = 0.2, and £3 = 0.4. Let the performance variable be that defined above with C p and D u 
being identity and D p f being zero. 

Assume w\ is a light shone in the cavity. In what follows a controller is to be designed to minimize the if 00 
norm from w\ to z. First of all, implementing step 1 yields an indirect coupling with parameters 

0.7372 1.3695 
-6.5299 -7.0978 



.4 



K 



B K = 



-2.5963 -1.3831 
-0.0012 9.7887 



C K = 



0.1366 0.0423 
-0.6401 -0.7339 

With this controller (more precisely, indirect coupling), the resulting H°° norm is 1.7252. Secondly, step 2 is used 
to obtain a direct coupling parameterized by 



B11 



0.0336 0.0128 
0.0403 0.0403 



. B21 



-0.0403 0.0128 
0.0403 -0.0336 



which yields an H°° norm with value 1.6889. Finally, fix M and N obtained in Step 1, Solving d62b and ( l63b 
produces another indirect coupling with parameters 

-0.0001 0.4002 

-0.1604 -3.6773 



IK 



Bfc = 10 4 x 



-0.0001 -0.0001 
-0.0000 1.2458 



§In this example and all the examples below, the quantum plant is a single quantum oscillator. Consequently, a is the same as x in [20], and 
all systems matrices are the same as those defined in [20]. 
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C K = 10" 



0.0718 0.0000 
0.0192 -0.2952 

Clearly, this controller is ill-conditioned. On the other hand, let M = N be identity matrix. Solving d62l and 
produces another indirect coupling with parameters 

0.0863 0.4907 
-20.1977 -20.2797 



.4 



K 



B 



K 



C K = 



-1.3563 -0.6781 

-0.0003 162.3435 

0.0062 0.0005 

-0.1226 -0.1255 



With this controller (with both direct and indirect couplings), the resulting H°° norm is 1.6056. If [ B K B 2 \ ] an d 

ly T (t) ~a T ( 
5.6] one has 



y T {t) a T (t) ] T are identified with Bk and y(t) in [20, Lemma 5.6] respectively, then following [20, Lemma 



B 



Kl 



0.1255 0.0005 
-0.1226 -0.0062 



B 



K2 



-15.50391. 



The resulting fully quantum controller is 

a K (t) = 



0.0863 0.4907 

-20.1977 -20.2797 

-0.0403 0.0128 

0.0403 -0.0336 

0.1255 0.0005 

-0.1226 -0.0062 



-15.5039 






-15.5039 



-1.3563 -0.6781 
-0.0003 162.3435 



fi(t) = 



a K (t) 
5(t) 

VKl(t) 
VK2(t) 

CLK(t) + V K l(t), 



0.0062 0.0005 
-0.1226 -0.1255 

with 5if(0) = cik- Clearly, u(t) is the field output corresponding to field input VKi{t) (in vacuum state), while 
VK2(t) is an extra field input in vacuum state. 

Remark 5: On the one hand, this example illustrates the effectiveness of the proposed multi-step optimization 
procedure; on the other hand, it reveals some delicate issue in this procedure like the choice of M and N; some 
caution must be taken. □ 
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D. LQG Synthesis 

In this section we study the problem of coherent quantum LQG synthesis by means of both direct and indirect 
couplings. A simple example is first discussed which shows that, for simple quantum plants, general-purpose 
optimization methods can be used to tackle this problem. However, for more complex quantum plants, more 
systematic methods have to be developed. 

1) A Simple Example for LQG Synthesis: Given an open quantum plant parameterized by f2_ = 1, Q + = 
2, C_ = y/2, C+ — 0, and a closed quantum controller parameterized by fi_ = 2, fffl = y/2, = 
0, C { + ] = 0, assume a direct coupling of the form (0 where K- and K + are real numbers for simplicity. The 
resulting closed-loop system is 

h(t) = 



-1 - i 
2i 

K- 
-K. 



-2i 
-l + i 

-K+ 



a K (t) = - 



a(t) 
a K (t) - 
a K (t) -+ 



V2 
V2 



2i V2i 
-y/2i -2i 

Define a performance variable z = a(t). Define system matrices 



A rI = 



bin(t), 

a(t). 



•1 - i 


-2i 


-K- 


K+ 


2i 


-l + i 


K+ 


-K- 


K- 


K+ 


-2i 


-V2i 


K+ 


K_ 


V2i 


2 1 



V2 








-V2 















, c c 



10 
10 



As in section Ull-El the LQG control problem is to minimize, with respect to the direct coupling parameters 
K + , the LQG performance criterion Zoo = Tr ^C c iPlqgC],i^, where Plqg is the unique solution of the Lyapunov 
equation 



AciPlqg + PlqgAI + ^B cl B f cl = 0, 



(73) 



subject to the constraint that A c i is HurwitzQ 

There are many sets of (K^,K + ) such that A c i is not Hurwitz. Consequently, the Matlab function 'fminsearch' 
does not work well. Now if K-,K + E [—15, 15], A c i is Hurwitz and a simple search finds that 3oc = 1-0406 at 
K_ = —15 and K + = 11.1000. Extending the ranges of A'_ and K + will make Zoo decrease, but very slightly. 



^Note that the plant itself is not stable, hence Zoo = oo in the absence of stabilizing direct coupling. 
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Remark 6: If = 3, no direct coupling of the form with real K_ and K + can yield a stable composite 
system. As a result, we have to allow K- and K + to be complex numbers. Joint effort of both direct and indirect 
couplings may do a better job. □ 

2) The General Case: The simple example in section HV-D . 1 1 tells us that stability of closed-loop systems poses a 
big obstacle to quantum LQG control via general-purpose optimization algorithms. In this section a more systematic 
algorithm is proposed. 

Given a quantum plant P of the form (l52l with the absence of the quantum signal w(t) and noise input b v (t), a 
fully quantum controller d53l is to be designed to minimize the infinite-horizon LQG cost defined in section IIII-EI 
For ease of presentation, denote the following matrices 

A B u Ck + B\2 

BrC + B21 Ak 



A r 



Grl = 



C, 



Clearly, A c j is the the A-matrix of the closed-loop system 
is the unique solution to the following Lyapunov equation 



Bf B u Bkq 
BrDj Bki Bk2 

C p D u Ck 

If A c i is Hurwitz, a positive definite matrix Plqg 



AciPlqg + PlqgAI + -G^l = 0. 



(74) 



Following the development in section IIII-EI the LQG control objective is to design a controller d53l such that the 
performance index 3oo = Tr |c c /PlqgCc(} * s minimized, subject to equation (|74"l i and the physical realizability 
condition (fT0T>-(TTTTl and 

In [29] an indirect coupling is designed to address the preceding LQG control problem, where it is shown that this 
problem turns out to be more challenging than the H°° quantum control because the nice property of separation of 
control and physical realizability does not hold any more. Therefore, a numerical procedure based on semidefinite 
programming is proposed to design the indirect coupling. In order to design both direct and indirect couplings, 
a multi-step optimization algorithm like that in section IIV-C.3I can be developed. The effectiveness of such an 
optimization algorithm is illustrated by the following example. 

3) Example: Consider the quantum plant in d72l ) with parameters A = 0.1 and k\ = k% = = 0.01. This 
plant can be used to model an atom trapped between two mirrors of a three mirror cavity in the strong coupling 
limit so that the cavity dynamics can be adiabatically eliminated (see, e.g., [13]). To guarantee the finiteness of the 
LQG performance, assume w\(t) = in d72l . According to [20, Theorem 3.4], y(t) is the field output quadrature 
corresponding to the field input quadrature 6, ni i(t). Note that the quantum plant is marginally stable. A stabilizing 
indirect coupling is designed in [29, sec. 8] with parameters 



.4 



A" 



0.0257 -0.3789 
0.0666 -0.2125 



B 



Kl 



0.1126 -0.5992 
0.1504 -0.1283 
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B K 2 



10 



-10 



-0.2721 0.0272 
-0.1096 0.0601 



D 



K 



1.0297 
0.8255 



-0.1974 
-0.0503 



K 



0.1283 
0.1504 



-0.5992 
-0.1126 



The resulting LQG cost 3oc is 4.1793, which greatly outperforms the performance Qoo = 5.4) achieved by a 
classical controller modulating a light beam to drive the fully quantum plant [29]. Next we add direct coupling to 
improve further. By choosing 



B 



12 



10" 



1.2 -9 
0.72 0.36 



,B 



21 



10" 



-0.36 
0.72 



-9 
-1.2 



Then it can be verified readily that 3oc = 4.000049633093338. The combination of direct and indirect couplings 
offers an improvement in performance compared to the controller design in [29] involving only indirect coupling. 



V. Conclusion 

In this paper, we have investigated the influences and uses of indirect and direct couplings in coherent feedback 
control of linear quantum stochastic feedback systems. In particular, we have shown that the uses of direct coupling 
can have beneficial performance consequences, and that the design of direct couplings may be achieved in a 
systematic, optimization-based approach. The results of this paper will help to build an integrated, first-principles 
methodology for coherent quantum control. Future work will include further practical application of the synthesis 
method of direct couplings in the field of quantum optics. 
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